1 link tagged with all of: data compression + lossless compression + transformer + benchmark
Click any tag below to further narrow down your results
Links
tufazip is a Transformer-based compressor for the enwik9 benchmark, reported at 105,388,353 bytes total once the decoder archive is counted. The repo gives the exact commands, file hashes, and hardware needed to reproduce the decode.
- Compressed enwik9 is 100,958,324 bytes, with a 4,430,029-byte decoder ZIP, for a ranked total of 105,388,353 bytes.
- It is an online Transformer initialized from a quantized offline Cycle2 prior, and needs two NVIDIA B200 GPUs.
- Compression takes about 631,548 seconds and decompression about 645,748 seconds, so it is far from a practical everyday tool.